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Abstract. The reciprocal class of a Markov path measures is the set of all the mixtures 
of its bridges. We give characterizations of the reciprocal class of a continuous-time 
Markov random walks on a graph. Our main result is in terms of some reciprocal char¬ 
acteristics whose expression only depends on the intensity of jump. We also character¬ 
ize the reciprocal class by means of Taylor expansions in small time of some conditional 
probabilities. 

Our measure-theoretical approach allows to extend significantly already known re¬ 
sults on the subject. The abstract results are illustrated by several examples. 


Introduction 

This article answers the questions: "When does a continuous-time random walk on a 
graph share its bridges with a given Markov walk?" and " What does a random walk share 
with its bridges?”, both in terms of their intensities of jumps and of Taylor expansions 
in small time of probabilities of conditioned events. The precise answers are stated at 
Theorem 2.4 and Corollary 2.10 which are our main results. 

The set of all path measures sharing the bridges of a given Markov measure is called 
its reciprocal class. In contrast with the existing literature about reciprocal classes, 
i.e. shared bridges, which relies on transition probabilities, in this paper we adopt 
a measure-theoretical approach: our main objects of interest are path measures, i.e. 
probability measures on the path space, rather than transition probability kernels. It 
turns out that this is an efficient way for solving our problem and allows to extend 
significantly already known results on the subject. 
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Notation. Some notation is needed before bringing detail about the above questions 
and their answers. For any measurable space Y, P(F) denotes the set of all probability 
measures on Y. We denote the support of a probability measure p by supp p. On a dis¬ 
crete space A, we have suppp = {a e A : p{a) > 0} and for any probability measures p 
and q, p is absolutely continuous with respect to g : p g, if and only if supp p C supp g. 
The support of a function u G is defined as usual by suppu := {a e A : u{a) ^ 0} . 
Functions with a finite support will be useful to define Markov generators without 
extra assumptions on the intensity of jumps. 

We consider random walks from the unit time interval [0,1] to a countable directed 
graph {X,A) where only jumps along the set A (Z oi the arcs of the graph are 
allowed. The set of all the sample paths is denoted by C As we adopt a 

measure theoretical viewpoint, it is worth identifying the random processes and their 
laws on the path space. Consequently, any path measure P G P(tt) is called a random 
walk. 

The canonical process on Vt is denoted as usual by (Xg 0 < t < 1). For any random 
walk P G P(tt) we denote 

• Po{dx) := P{Xq G dx) G P(d:’), its initial marginal; 

• Poi{dxdy) := P{Xo G dx,Xi G dy) G P(T’^), its endpoint marginal; 

• P* := P(- I Xo = t) G P(tt), the random walk conditioned to start at t G 
supp Po; 

• P^y := P(- I Xo = T, Xi = y) G P(fl), its xy-bridge with (x, y) G supp Pqi. 

Aim of the article. We take some Markov random walk R G P(tt) with an intensity of 
jumps j : [0,1] X A —)■ [0, oo) and we assume that its initial marginal Pq ^ P('b’) has a 
full support. This random walk is our reference path measure. 

For comparison with the results of this article, let us consider for a little while the set 

M(j) := I 5^/io(T)P";/io e P(A) I c P(tt), 

UeT J 

assuming that for any x, P® is uniquely well defined. Obviously, for any P G P(fi), the 
three following statements are equivalent: 

(1) PeM(j); 

(2) P^ = R^, for all x G supp Pq; 

(3) For any x G supp Pq, P® is Markov with intensity j. 

Rather than the collection of all random walks P* conditioned by their starting point 
X Z X, our interest is in the bridges of P. We define 

P(j) ;= < ^2 'n'ix,y) R^^-,71 G V^X"^) : suppvr C supp Pqi > C P(fl) (1) 

J 

to be the convex hull of all these bridges. This set is called the reciprocal class of the 
intensity j. Since the reference random walk P is Markov, so are its bridges P*^. But, 
in general a mixture of such bridges fails to remain Markov. However, any element P 
of P(j) still satisfies the reciprocal property which extends the Markov property in the 
following way. 

Definition 0.1 (Reciprocal walk). A random walk P G P(fl) is said to be a reciprocal walk 
if for any 0 ^ u ^ u ^ 1, P(X[„„] G ■ | Xjq^^], Xj,; j^]) P(Xj„,j;j G • | X„,X,;). 
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The reciprocal property of a path measure is defined in accordance with the usual 
notion related to processes. Basic material about reciprocal walks is collected at Ap¬ 
pendix A. 

We see clearly that for any P G P(fl) such that supp Pqi C supp Poi, the two following 
statements are equivalent: 

(ly P G P(j); 

( 2 ) ' P^y = for all (x, y) G supp Pqi- 

The aim of the article is to provide an analogue of statement (3) above. Indeed, Theo¬ 
rem 2.4 states that (1)' and (2)' are equivalent to 

(3) ' For any (x, y) G supp Pqi, P^^ is Markov and 

x[k^y] = x[j], ( 2 ) 

where is the intensity of P*^ and X[k^y], X[j] are described at Definition 2.3. For this 
reason, X[j] is called the characteristic of the reciprocal class P(j). 

There are other random walks P than R in TZ{j) that are Markov. In this case, for 
every x G suppPo, the intensity k^ of P* does not depend on x. When k^ depends 
explicitly on x, P is not Markov; this is the case for most of the elements of P(j). 

Variational processes. Beside the interest in its own right of the description of the con¬ 
vex hull of the bridges of some Markov dynamics, there exists a stronger motivation for 
investigating the reciprocal class of a Markov process. Suppose that you observe two 
large samples of non-interacting particles systems 1 and 2 with two distinct endpoint 
distributions (i.e. empirical measures of the couples of initial and final positions). Are 
these two random systems driven by the same force field? In mathematical terms, you want 
to know if the path measures Pi and P 2 corresponding to the systems 1 and 2 belong 
to the same reciprocal class. To understand this equivalent statement, let us provide 
some comments. This question is rooted into a problem addressed by Schrodinger in 
the early 30's in the articles [Sch31, Sch32]. 

Schrodinger problem. Consider a large number N of independent particles labeled by 
1 < i < N and moving according to some Markov dynamics described by the reference 
path measure R G P(fl). In Schrodinger's papers, R is the law of a Brownian motion on 
A = M” and = C'([0, Suppose that at time t = 0, the particles are distributed 

according to a profile close to some distribution po G P(A). In modem terms, this 
means that the empirical measure -f Yji<i<N '^Vi(o) of the initial sample is weakly close 
to po, where 6a is the Dirac measure at a and t 1 —)■ Xft) describes the random motion 
of the z-th particle. Suppose that at time t = 1 you observe that the whole system is 
such that its distribution profile -f X]i<i<Ar ^Vi(i) is weakly close to some pi G P(A) far 
away from the expected profile poc^ G P(A) which is predicted by the law of large 
numbers. Here, L is the Markov generator of R. Schrodinger asks what is the most 
likely trajectory of the whole particle system conditionally on this very rare event. As 
translated in modem terms by Follmer in [F 0 I 88 ] using large deviations technics, the 
empirical measure -f weakly tends in P(12) to the unique solution of the 

entropy minimization problem 

H{P\R) -)■ min; P G P(fl) : Pq = po, Pi = pi, (3) 

where H{P\R) := Ep \og{dP/dR) G [0, cx)] is the relative entropy of P with respect to 
the reference measure R. A recent review of the Schrodinger problem is proposed in 
[Leol4]. 
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A stochastic analogue of Hamilton's principle. In the case where i? is a Brownian mo¬ 
tion, any P G P(II) with H{P\R) finite is the solution of a martingale problem associ¬ 
ated with some adapted drift field (5^ such thaf Ep \l3ffdt < oo and H{P\R) = 

/[0,1] \l3f’f/2dt. As |/3f p/2 is a kinetic energy, H{P\R) is an average kinetic action 
and the minimization problem (3) appears to be a stochastic generalization of the usual 
Hamilton variational principle, see for instance [Leol4] and the references therein. 

A natural extension of Schrodinger's problem. Problem (3) also admits the following nat¬ 
ural extension 

H{P\R) min; P G P(fi) : Poi = tt (4) 

with TT G P(A^) a prescribed endpoint distribution. In some sense, the entropy mini¬ 
mization problem (4) is the widest stochastic extension of the classical Hamilton least 
action principle. 

The connection with the reciprocal class TZ[j]. To see the coimection with the bridges of R, 
let us go back to our discrete set of vertices X and note that both problem (3) with the 
prescribed marginals po = 6x and pi = 6y and problem (4) with tt = 5(x,y), admit the 
unique solution 

P = R^y. 

This is a simple consequence of the additive decomposition formula 

HiP\R) = H{PofRoi) + Poi{x,y)H{P^y\R^y) 

applied with Pqi = ^{x,y)- One can interpret the bridge R^y as the stochastic analogue of 
a minimizing geodesic between x and y. We also see with the additive decomposition 
formula that the unique solution of (4) with a general endpoint distribution vr G P(d:’^) 
such that H{tt\Roi) < oo is 

P= Yi, !/)«”■». 

x,y&X 

Therefore, the reciprocal class P(j) appears to be essentially the set of all the solutions 
of the stochastic variational problem (4) when vr G P(A^) describes all the possible 
endpoint distributions. In addition, we see with (2) that the bridges of R all satisfy 

X[fy] = X[j], V(x,y) G suppPoi- 

This indicates that the reciprocal characteristic X[j] encrypts the underlying stochastic La- 
grangian associated with the stochastic action minimization problem (4). 

This point of view is developed in a diffusion sefting by Zambrini and the second 
author in [LZ]. It will be explored in the present setting of random walks on graphs in 
a forthcoming paper. 

At the present time very little is known about the solutions of the variational prob¬ 
lems (3) and (4) in the setting of random walks on graphs. This paper is a contribufion 
in this direction. 

Literature. One year after Schrodinger's article [Sch31], Bernstein introduced in [Ber32] 
the reciprocal property as a notion that extends Markov property and is respectful of 
the time reversal symmetry. It was further developed four decades lafer by Jamison 
[Jam74, Jam75]. Relying on Jamison's approach fo reciprocal processes, Clark proved in 
[Cla91] a conjecture of Kroner [Kre88] who proposed a characterization of the recipro¬ 
cal class of a Brownian diffusion process in terms of an identity of the type X[/3^] = X[0] 
where (5^ is the drift of the Markov diffusion process P (recall the discussion below 
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Eq. (3) for the notation (3^). Clark called X[(3^] a reciprocal invariant. In the present arti¬ 
cle, we prefer naming "reciprocal characteristics" the analogous quantities X[k].^ In view 
of the previous discussion about variational processes, it is not surprising that the re¬ 
ciprocal characteristics play a distinguished role when looking at reciprocal processes 
as solutions of second order stochastic differential equations. This is investigated by 
Krener, Levy and Thieullen in [KL93, Thi93, Kre97]. 

Characterization of reciprocal classes can also be stated in terms of stochastic integra¬ 
tion by parts formulas, often called duality formulas. This was investigated by Roelly 
and Thieullen in [RT04, RT05] for diffusion processes. In the specific context of count¬ 
ing random walks, this is done in [CLMR15], a paper by Murr, Roelly and the authors 
of the present article. This was extended by Dai Pra, Roelly and the first author in [CPR] 
for compound Poisson processes and in [CR] tor random walks on Abelian groups. A 
main idea of [CPR, CR] is to exploit the translation-invariant structure of the underly¬ 
ing graph to characterize the reciprocal classes through integration by parts formulas 
where the derivation measures the variation when adding a random closed walk to 
the canonical process, see [CPR, Thm. 3.3] and [CR, Thm. 13]. In all these cases, recip¬ 
rocal characteristics play a major role. If the graph is not assumed to be invariant with 
respect to some group transformations, such as translation-invariance and time homo¬ 
geneity, there is no way of thinking of a natural derivative. Since we do not assume any 
invariance in the present article, the integration by parts approach is not investigated. 

It is worthwhile to note that, except for [RT04] and the recent papers [CLMR15, CPR, 
CR, LZ], in the whole literature on the subject, only the Markov members of the recipro¬ 
cal class, that is the solutions of the original Schrodinger problem (3) as the marginal 
constraints vary, are characterized. In the present article, following a strategy close to 
[LZ]'s one, we give a characterization of the whole reciprocal class, that is the set of 
solutions of (4) as tt varies, under very few restrictions on the reference random walk. 

Outline of the paper. Next Section 1 is devoted to some preliminaries about directed 
graphs, Markov walks and their intensities. We also state our main hypotheses which 
are Assumption 1.1 and Assumption 1.5 and define carefully the reference path mea¬ 
sure R. Our main results are stated at Section 2. They are Theorems 2.4 and 2.7, to¬ 
gether with their Corollary 2.10. Theorem 2.4 is a rigorous version of statement (3)' 
while Theorem 2.7 provides an interpretation of the reciprocal characteristics in terms 
of Taylor expansions in small time of some conditional probabilities. Their proofs are 
done at Section 3. The key preliminary result is Lemma 3.1 whose proof is based on the 
identification of two expressions for the Radon-Nikodym derivative /dR. Several 
examples are treated at Section 4. We have a look at: birth and death processes, some 
planar graphs, the hypercube, the complete graph and some Cayley graphs. We cal¬ 
culate their reciprocal characteristics and sometimes solve the associated characteristic 
equation. Linally, there are appendix sections devoted to reciprocal random walks and 
to closed walks on a directed graph. 

1. Preliminaries 

This section is devoted to some preliminaries about directed graphs, Markov walks 
and their intensities. Our main hypotheses are stated below at Assumption 1.1 and 

Tn the contexts of classical, quantum and stochastic mechanics (the latter being taken in its wide ac- 
ception including Nelson's mechanics [Nel85], Euclidean quantum mechanics [CZ08] or hydrod 5 mamics 
where the evolution is deterministic but the initial state is described by a probability measure), the term 
"invariant" refers fo conserved quantifies as fime varies. 



6 


GIOVANNI CONFORTI AND CHRISTIAN LEONARD 


Assumption 1.5. Much of the material in this section is required for the definition of 
the reciprocal characteristics and the statements of our results at Section 2. 

Directed graphs. Let A be a countable set and A C The directed graph associated 
with A is defined by means of the relation — )■, meaning that for dA z^z' G X we have 
z ^ z' ii and only if {z,z') G A. We denote (A, — )■) this directed graph, say that any 
{z, z') G A is an arc and write {z z') E A instead of {z, z') G A. 

We are concerned with directed graphs (A, —)■) satisfying the following: 

Assumption 1.1. The directed graph (A, —)■) satisfies the following requirements. 

(1) A is symmetric: {x ^ y) E A ^ {y ^ x) E A. 

(2) It is connected: for any x, y there exists a directed walk from x to y. 

(3) It is of bounded degree. 

(4) It has no loops, meaning that for all z E X, {z ^ z) ^ A. 

Let us also give some definitions which are necessary to state our main results. Here, 
we use some standard vocabulary in graph theory. For more detail about walks, simple 
walks, closed walks, we refer fo Appendix B. 

Definitions 1.2 (Tree and basis of closed walks). 

(a) We call tree a symmetric connected subgraph T of (A, —)■) with no closed walks of length 
at least three. In this paper a tree is always a spaiming tree, in the sense that it connects 
any pair of vertices in X. 

(b) Let Tbe a tree. If {x ^ y) ^ T, we denote the closed walk obtained by concatenating 
X ^ y with the only simple directed walk from y to x in T. 

(c) Let T be a tree. A T-basis of the closed walks of (A, —)■) is any subset C of closed walks 
of the form: 

C = Co U £ 

where 

£ := {(x -E y ^ x), {x ^ y) E X^} 

stands for the set of all edges and Cq is obtained by choosing for any (x—)■?/—)■ t) E £\T 
exactly one among and iy^^ 

With the above construction, all elements of a basis of closed walks are indeed closed 
walks. We refer fo [BM07, Sec. 2.6] for the notion of cycle basis of an undirected graph. 

Random walk on a graph. The countable set A is equipped with its discrete topology. 
We look at continuous-time random paths on (A, —)■) with finitely many jumps on the 
bounded time interval [0,1]. The corresponding path space Ll C consists of all 

cadlag piecewise constant paths u = {uJt)o<t<i on A with finitely many jumps such that 
Ui- = ui and for all t E (0,1), Ut- 7 ^ oJt implies that Ut- -E Ut- It is equipped with the 
canonical cx-field generated by the canonical process. 

Definition 1.3. We call any probability measure on LI a random walk on (A, —)■). 

This is not the customary usage, but it turns out to be convenient. As a probabil¬ 
ity measure, it specifies the behavior of a piecewise consfanf continuous-fime random 
process thaf may nof be Markov. 
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Notation related to random walks. As usual, the canonical process X = (Xt)ig[o,i] is de¬ 
fined for each t G [0,1] and u = {ujs)o<s<i G by Xt{u) = Ut ^ X. For any X c [0,1] and 
any random walk P G P(fl), we denote Xx = {Xt)t£x and the push-forward measure 
Px = {Xx)#P. In particular, for any 0 < t < 1, Pt = {Xt)#P G denotes the law 

of the position Xt at time t and Pqi := P{o,i} denotes the law of the endpoint position 
(Ao, Xi). Also, for all 0 < r < s < 1, = {Xt)r<t<s and = {X[r,s])#P- 

We are mainly interested in bridges. In a general setting, one must be careful because 
the bridge P^^ is only defined Poi -almost everywhere. But in the present case where 
the state space X is countable, the kernel (x, y) i-)- P^^ is defined everywhere on supp Pqi, 
no almost-everywhere-precaution is needed when talking about bridges. In particular, 
any random walk P disintegrates as 

P= Poi(x,i/)P"^GP(ff). 

(a:,y)esuppPoi 

In the whole paper, the letters x and y are devoted respectively to the initial and final 
states of random walks. Current states are usually denoted by 2 ;, z' G X. 

Markov walk. The Markov property of a path measure is defined in accordance with 
the usual notion related to processes. 

Definition 1.4 (Markov walk). A random walk P G P(ri) is said to be a Markov walk if for 
any 0 <t < 1, P{X\t,i] G ■ | A[o,t]) = P(X[t^i] G ■ | Xt). 

A Markov walk P G P(fl) is the law of a continuous-time Markov chain with its 
sample paths in fl. In our setting, all the Markov walks to be encountered will be 
associated with some intensity of jumps^ k ■. [0, 1) x A —)■ [0, cx)) which gives rise to 
the infinitesimal generator that acts on any real function u G with a finite support 
via the formula 

Ktu{z) = k{t, z ^ z) {uz'— Uz), z G A, f G [0, !)• 

The random walk P G P(fl) is such that for any real function u e with a finite 
support, the process u{Xt) — Ksu(Xs) ds is a local P-martingale with respect to the 
canonical filtration. The average frequency of jump from 2 ; at time t is 

k{t,z):= kit^z^z'). (5) 

z':z^z' 

Note that this is a finite number because it is assumed that (X, —)■) is locally finite. The 
sample paths of the random walk P admit a version in if and only if k{t, z —)■ z') is 
t-measurable for all z and z' and 

/ k(t,Xt) dt < 00 , P-a.s. 

J[o,i) 

Indeed, this estimate means that the canonical process performs P-a.s. finitely many 
jumps. 

In the situation where k doesn't depend on t, the dynamics of the random walk is 
described as follows. Once at site z, the walker waits during a random time with ex¬ 
ponential law with parameter k{z) and then jumps onto z' according to the probability 

9rm 

This is maybe the case for any Markov walk with finitely many jumps, but we shall not need to 
investigate such a general existence result. 
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measure k{z)~^ Yl,z'-z^z' z')6z> where 5^/ stands for the Dirac measure at z', and 

so on; all these random events being mutually independent. 

Note that k{t, •) and Kt are only defined for t in the semi-open interval [0,1). The 
reason for this is that we are going to work with mixtures of bridges and the forward 
intensify of a bridge is singular at f = 1. 

The reference intensity of jumps and the reference random walk. We introduce a 
random walk R G P(ff) with intensity of jumps j. Both R and j will serve as reference 
path measure and intensity 

Assumption 1.5. The Markov jump intensity j : [0,1] x ^ [0,oo) verifies the following 
requirements. 

(1) The estimate 

sup j{t,z)<oo (6) 

t&[o,i],zex 

holds where, as in (5), j{t, z) := Xlz'^ ^0 stands for the average frequency of 

jump from z at time t. 

(2) j is continuously t-differentiable, i.e.for any (z z') e A the function f i-)- j(f, z —)■ zf 
is continuously differentiable on [0,1]. 

(3) j is positive: 

Vf G [0,1])-^ —t z^ G A^ j(t, z —y zf > 0 

The Assumption 1.5 (1) implies that for each x E X, there exists a unique solution 

R^ G P{Q) 

to the martingale problem with initial marginal dx associated with the generator L = 
(Li)o<f<i defined for all finitely supported functions u by 

Ltu{z) = j{t,z ^ zf{u^>-u^), tE[0,l],zEX. 

z'lZ^z' 

Because of the fact that (A, -e) is cormected and Assumption 1.5 the bridge R^^ := 
R^{- \ Xi = y) of R^ is well defined for all x,y E The reference random walk is 
defined by: 

R ■=J2Ro{x) R" e P(fi) 

x&X 

where the initial marginal Rq is any probability measure on X with a full support, i.e. 
supp Rq = X. 


2. Main results 

Before stating the main results of the article, we still need to introduce two objects 
which are related to the notion of reciprocal walk, see Definition 0.1 for this notion. 

Reciprocal class. The reciprocal class R{j) is defined at (1). It is the main object of our 
study. 

Proposition 2.1. The reciprocal class Tl{j) is a set of reciprocal walks in the sense of Definition 
0.1, which are absolutely continuous with respect to R. 

Proof. By its very definition, TZ{j) is the subset of all convex combinafions of the bridges 
of the Markov walk R. Remark A.3(d) tells us that any P E Tl{j) is reciprocal. More¬ 
over, Proposition A.l tells us that P R because supp Pqi = supp vr C supp Rqi = 

AT □ 
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Remark 2.2. Since any element of 7^(j) is absolutely continuous with respect to R, by 
Girsanov's theory it admits a predictable intensity of jumps, see [Jac75, Thm. 4.5]. This 
will be used constantly in the rest of the article. 

Reciprocal characteristics. We are going to give a characterization of the elements of 
TZ{j) in terms of reciprocal characteristics which we introduce right now. 

Definitions 2.3 (Reciprocal characteristics of a Markov random walk). Let k be a jump 
intensity which is assumed to be continuously t-dijferentiable and positive, i.e. for any {z — 
z') G A the function t ha k{t,z —)■ z') is continuously differentiable on the semi-open time 
interval [0,1) and positive on (0,1). 

(a) We define for all t G (0,1) and all {z —>■ z') G A, 

Xa[k](t, z —>■ z') := dt log k{t, z ^ z') k(t, z') — k(t, z) 
where k is defined at (5). 

(b) We define for all t G (0,1) and any closed walk c = (xq —■ • • —X|c| = xq) on (df, —)■) 

|c|-l 

Xfkft.c) := k{t,Xi -tXi+i). 
i=0 

See Definition B.l for the notion of closed walk. 

(c) We call X[k] = {Xa[k],Xc[k]) the reciprocal characteristic of k. 

The term Xa[k] is the arc component and Xfk] is the closed walk component ofX[k]. 

Note that under our regularity assumption on k, dt acts on a differentiable function: 
X[k] is well defined. 

The main results. They are stated at Theorems 2.4, 2.7 and Corollary 2.10. Theorem 
2.4 gives a characterization of the reciprocal class of j in terms of the reciprocal char¬ 
acteristics. Theorem 2.7 provides an interpretation of the reciprocal characteristics of 
a reciprocal walk by means of short-time asymptotic expansions of some conditional 
probabilities. Putting together these theorems leads us to Corollary 2.10 which states a 
characterization of the reciprocal class in terms of these short-time asymptotic expan¬ 
sions. 

Theorem 2.4 (Characterization of TZ{j)). We suppose that (df, —)■) satisfies Assumption 1.1 
and j satisfies Assumption 1.5. 

A random walk P G P(fl) belongs to Tl{j) if and only if the following assertions hold for all 
{x,y) G suppPoi- 

(i) The bridge is Markov^, P^^ ^ and its intensity k^^ is t-differentiable and posi¬ 
tive on (0,1). 

(ii) There exists a tree T such that for any t G [0,1) and any {z —>■ z') G T, we have: 

Xa[k'"f{t,Z z') = Xa[f\{t,Z^ z'). (7) 

(Hi) There exists a T-basis of closed walks C such that for any t G (0,1) and any c e C, we 
have 

Xc[k^f{t,c) = Xc[j]{t,c). (8) 

If P is itself Markov, Theorem 2.4 simplifies. Indeed, we do not have to check con¬ 
ditions (ii) and (hi) for any (x, y) G supp(Poi)/ but we can simply test their validity on 
the jump intensity of P. We shall construct in Section 4 different time-homogeneous 
Markov walks in the same reciprocal class. 

^But this doesn't imply that P is Markov. 
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Corollary 2.5 (Markov elements of a reciprocal class). We suppose that {X, —)■) satisfies 
Assumption 1.1 and j satisfies Assumption 1.5. Let P be a Markov walk of intensity k, which 
is continuously differentiable and positive on (0,1). Then P G lZ{j) if and only if items (ii) 
and (in) of Theorem 2.4 hold with k instead ofk^^. 

Proof. Since P^^ e lZ(k) then for all x,yan application of Theorem 2.4 tells that Xa [k^^] = 
Xa[k] over T and Xc[k^'^] = Xc[k] over C . But then checking (ii) and (iii) for k^^ is the 
same as checking it for k. □ 


The intensity of a bridge can be found by solving the following equation, which we 
call characteristic equation. 


Corollary 2.6 (Characteristic equation). Let C be a basis for the closed walks and T be a 
rooted tree. The intensity of the xy bridge is the only classical solution of: 


= Xc[j]{t,c), t E (0,1), c eC 

Xa[j'"^]{t,Z -)■ A) = Xa[j]{t,Z -E- z'), t E (0,1), (z -E z') E T 


subject to the boundary conditions 


fy(t,z)dt 


-\og R^(y) + flj(t,y)dt 
—oo, 


ifz = y 
otherwise 


( 10 ) 


Proof. Equation (9) is a direct consequence of (i),(ii),(iii) of Theorem 2.4. Concerning the 
boundary conditions, we will use Lemma 3.1. From the HJB equation (16) we deduce 
that 


dt(t>t(z) = j(t,z) - fy(t,z) 


Integrating in time the last equality and using the boundary conditions for f, see (14), 
it follows that a valid set of boundary conditions is given by (10) □ 


The reciprocal characteristics come with a natural probabilistic interpretation which 
is expressed in terms of short-time asymptotic for the distribution of bridges. We shall 
show that they can be recovered as quantities related to Taylor expansions as > 0 
tends to zero of conditional probabilities of the form P(X]^t,t+h] ^ ■ I Xt, Xt+h)- This is 
the content of Theorem 2.7 below. Lef us infroduce the notation needed for its state¬ 
ment. For any integer k > 1 and any 0 < f < 1, we denote by T^ the fc-th instant of 
jump after time t. It is defined for A; = 1 by T( := inf {s E (t, 1] : Xg- Xg} and for any 
/c > 2 by := inf {s G (T^_i, 1] : Xg- Xgj with the convention inf 0 = -|-cx). 


Theorem 2.7 (Interpretation of the characteristics). We suppose that (X, —)■) satisfies As¬ 
sumption 1.1 and j satisfies Assumption 1.5. Let P be any random walk in lZ{j). 

(a) Tor any t G (0,1), any (z -E- z') E A 

P(Tj < t h/2 I Xt = z,Xt+h = z',T2 > t -\- h) 

1 h (11) 

= 2 ~ Z ^ z') + Oh^o+(h). 

(b) Tor any t E (0,1) and any closed walk c, we have 


P(^(Xt Xrpt Xrpt^^ — Xt) 


^|c| <t + h< T^c\+i I Xt — Xt+h^ 

= Xc[j](f,c)/il^l/|c|! + 


( 12 ) 
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Remark 2.8. The link between reciprocal characteristics and short time asymptotic for 
continuous-time random walks was sketched in [CPR] in the particular case when the 
graph is a lattice and the intensity is space-time homogeneous. Concerning the diffu¬ 
sion case, it is due to Kroner [Kre97]. 

Remark 2.9 (Reciprocal characteristics and the concentration of measure phenomenon). 
The interpretation of the characteristics given in Theorem 2.7 can be used to make 
quantitative statements on the behavior of a bridge whose lifetime is very short. How¬ 
ever, it is a very natural question to ask what happens for non-asymptotic time scales, 
and if one is able to give natural conditions on the characteristics under which the fluc¬ 
tuations of a bridge can be controlled. This question is the object of the forthcoming 
work [Con]. In particular, the connection between reciprocal characteristics and the 
concentration of measure phenomenon is made there. 

In the same spirit that a Markov walk is specified by the Markov property and its 
jump intensity which can be obtained as the limit in small time of a conditional expec¬ 
tation, we obtain the following characterization of 7?.(j). 

Corollary 2.10 (Short-time expansions characterize TZ{j)). A random walk P G P(12) 
belongs to TZ{j) if and only if the following assertions hold . 

(i) P is reciprocal in the sense of Definition 0.1, and for all x,y e supp Pqi, P^'^ and 

its intensity is t-differentiable on [0,1). 

(ii) There exists a tree T such that for any t e (0,1), any {z —)■ z') G T, the identity (11) is 
satisfied. 

(in) There exists a T-basis of closed walks C such that for any t G [0,1) and any c e C, we 
have that the identity (12) is satisfied. 

Proof. The necessary condition is a direct consequence of Theorems 2.4 and 2.7. For the 
sufficient condition, all we have to show is that the properties (a) and (b) of Theorem 
2.7 respectively imply the properties (ii) and (iii) of Theorem 2.4. 

First we observe that, thanks to the reciprocal property, (a) and (b) extend to any bridge 
of P. The same calculations as in Theorem 2.7's proof at page 16 show that replacing 
R by P^y and j by lead to the same conclusions with k^"^ instead of j. It remains to 
compare the resulting expansions to conclude that (7) and (8) are satisfied. □ 

Remark 2.11 (Second order calculus for diffusion processes). In the diffusion case, re¬ 
ciprocal processes have been used to develop a "second order calculus" for diffusions. 
In particular Krener shows in [Kre97] that each element of a reciprocal class is char¬ 
acterized through a set of differential characteristics. In this setting, reciprocal char¬ 
acteristics provide the acceleration terms, and are therefore coimected to second order 
expansions, see [Kre97, Thm 2.1]. This is certainly not possible in the graph case. In¬ 
deed to capture the closed walk characteristic one has to expand up to the length of the 
walk which, apart from trivial cases, is always at least three. However, some analogies 
are still present. Indeed, it is a commonly accepted interpretation that, in the case when 
j does not depend on time, the "speed" of the walk, once it is at site z, is j (z). The recip¬ 
rocal characteristic Xa[j]{t, z —)■ z') associated with the z ^ z' is precisely j{P) — j{z): it 
is a difference of velocities and hence it has the resemblance of an acceleration. Clearly, 
this analogy is far from being anything rigorous and we do not make any claim of 
physical relevance here. 
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3. Proofs of the main results 


Let P be any Markov walk such that P R. Therefore P admits an intensity k{t,z —)■ 

z') and the related Girsanov formula (see [Jac75]) is for each x e supp Po, 


dP^ 

dR^ 


= l{^=oo} exp 


where the stopping time r is given by 


V log -{t, X,- ^ Xt) - f {k-j){t,x,-)dt ] (13) 

J Jo 


T 


:= inf < i G [0,1]; k{t, Xt- —)■ Xt) = 0 or / k{s, ds = cxd 1 G [0,1] U {oo} (14) 


with the convention inf 0 = cx). Note that i?^-almost surely j(f, Xt- —)■ Xt) > 0, for all 
t G [0,1) and j(t,Xt-) dt < oo. 


We start with a lemma, where we exploit h-transform techniques. 

Lemma 3.1 (HJB equation). For any x,y e X the intensity of the R^^-bridge is given by 

fyf, z ^ R) = exp(0t(2;') - (j)t{z))j{t, z z') (15) 

where f is the unique classical solution of the HJB-type equation: 

dtftiz) + ^ z') - 1] = 0, t,ze (0,1) X X (16) 

z':z^z' 


subject to the boundary conditions 


lim (j)t{z) = 




-log Rf{y), 
—oo, 


ifz = y, 
otherwise. 


(17) 


As usual, HJB is a shorthand for Hamilton-Jacobi-Bellman. 


Proof. We first note that 

h(xo := 

Thanks to our Assumptions 1.1 on the graph and 1.5 on the intensity, the function 
ht{z) := Ejix[hi(Xi) \ Xt = z] is everywhere well-defined and positive on (0,1) x A. 
Moreover, because of item (2) of Assumption 1.5, h is continuously differentiable as 
well. It is then a well known fact that h is space-time harmonic. This means that it is 
the unique classical solution of the Kolmogorov equation 

idtht{z) + Y.z'-.z^z'ji^^z^ z')[ht{z') - ht{z)] = 0, {t,z) G (0,1) x A, 

I lim 4 _ 5 .i- h[t, z) = h{z), x G A. 

Thanks to the positivity and regularity of h, we can consider its logarithm f := log h to 
obtain, after some standard computation that ft solves (16). Moreover, because of the 
definition of h we also have that (j)o{x) = 0. Let us define the intensity 

k{t, z^ z')= exp(0i(z') - (t)t{z))j{t, z-f z'). 
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Using Ito formula. 



and using Eq. (16), we can rewrite 

f dt4)t{Xt-)dt = - f ^ exp(0t(U) - 04(Xt-))(j(Xt- -)■ U) - 


z':X,-^z' 




Moreover, 


X] log[j(f,Xt- Xt) exp{(()t{Xt) - (()t{Xt-))] - log j{t,Xt- Xt) 

t-.X^.^Xt 

logk{t,Xt-^Xt)-logj{t,Xt-^Xt). 

t-.X,-^Xt 


Therefore, 

dR^y 


dR^ 


l{Xi=?;}exp^ ^ log-{t,Xt-^ Xt) - f {k - j){t,Xt-)dt 


As solves the HJB equation, with the definition (16) of k, we see that the event 
(r = +oo), recall (14), coincides R^-a.s. with the event {Xi = y). An application of 
Girsanov's theorem allows to identify the intensity j^y of R^y with k. □ 


Proof of Theorem 2.4. • Proof of (^). Let us show that P G 7^(j) shares the aimounced 
properties. If P G R{j), then P^y = R^y, which implies that k^y = j^y. Item (i) follows 
from Lemma 3.1. In particular, since 0 is a classical solution to equation (16), the de¬ 
sired regularity in time follows. Item (ii) and (iii) can be proven by replacing k^y with 
j^y. To prove item (ii) we observe that, using (15), (16) can be equivalently be written 
as 

dt(pt{z) = ^ z') - fy{t,z ^ z) = j{t,z) - fy{t,z), 

z'-.z^z' 

and therefore 

dt log fy{t, z^ z) = dt log j{t, z ^ z') + 

= dt logjik z^z')+ jit, z') - fyik zj - jit, z) + fyit, z). 
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from which (ii) follows. Item (ill) is a direct consequence of the gradient appearing in 
(15). Indeed, for any closed walk c = {xq ^ ^ Xn = xq) and any t e (0,1) we have 

n—1 n—1 n—1 

^ Xi+i) = ^ - M^i)) 

i =0 i =0 2=0 

= Xc[j]it,c)exp{(j)t{xn) - M^o)) = Xc[j]it,c), 


where the last identity follows from Xn = xq. 


• Proof of (4=). Fix {x,y) G suppPoi arid consider the bridge Thanks to item (i) 
we know that ^ R^. Therefore the Girsanov formula (13) applies and in 

restriction to [0, t], we have 




l{r=+oo} exp 



—)■ Xr) 



i){r,Xr-) dr 


where r is defined as 

r ;= inf |r G [0, t];/c'^^(r, X,.- —>■ X,.) = 0 or f X^-) ds = cxd| G [0, t] U {oo} . 

J[o,r] ^ 

The remainder of the proof is divided into tour steps. 

Step 1. We claim that 

{t = +oo}, R^-a.s. 

Indeed, by assumption, for any r G [0,1) and any arc ^ —)■ P, k^y{r,z z') < 
+ 00 . Since (X,—)-) is of bounded degree, we then have that k^y{r,z) is also 
finite. Using the fact that k^y{-,z —)■ z') is continuous on [0,t] and that P*-a.s. 
we observe finitely many jumps, we deduce that the integral X^- )dr is 

finite P^-a.s.. Moreover, since by assumption, fc^^(r, z ^ z') > t) for all r G (0,1) 
and 2 ; —>■ z', the only possibility to have k^y{r, X^- —)■ X^) = 0 is to have a jump 
at r = 0. But this does not happen P^-a.s.. 

Step 2. In this step we show the equality of all closed walk characteristics and all arc 
characteristics. To prove that Xc[A:*^](t, c) = Xc[j]{t, c) on a T-basis of the closed 
walks implies Xc[k^'’^]{t, c) = Xc[j]{t, c) for any closed walk, we first define the 
function 

i(z z') = \og]{t,z^ z') - \ogk^y{t,z^ z'). 

Item (iii) of Theorem 2.4 can then be rewritten as 

Vc G C, £(c) = 0 

where 

72—1 

•= ^ ^Hi) = log(Xb'](2,c) - X[k^y]{t,c). 

i=0 

The conclusion follows with an application of Lemma B.2, whose proof is de¬ 
tailed at Appendix B. Indeed, the implication (a) ^ (6) shows that ^(c) = 0 for 
any closed walk. But ^{c) is exactly log Xb'] (t, c) — X[k^'^] (t, c) (see Definition B.l). 

Let us turn to the arc characteristics. Consider any arc z —)■ z' . Then, since 
C is a T-basis of closed walks, either G C or ^ C/ recall Definition 
1.2. We assume w.l.o.g. that fz'^z ^ d/ the other case following with minor 
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modifications. If {z = Zq ^ ^ Zn = z') is the only simple T-walk from to z', 

we have 


z') 

= dt log z^z') + z') - k^y{t, z) 

n—1 

= dt log z ^ z') + '^ k^y{t, Xi+i) - k^y{t, Xi) 


(18) 


2=0 


n—1 


= dt\ogXc[k'^y]{t,z z' ^ z)- dtlogXc[A;^^](t,f^'^z) + '^Xa[k'"^]{t, Zi Zt+i). 


i=0 


Since fz^^z, (z —> z' —>■ z) e C and zt —>■ zt+i E T tor all 0 < i < n — 1, we 
can use (ii),(iii) to conclude that all the terms appearing in (18) coincide with 
those obtained by replacing with j. Repeating backward the computations 
that led to (18) we obtain that Xa[k^'^]{t^ z ^ z') = Xa[i]{t, z — )■ z'), which is the 
desired result. 

Step 3. In this step we show that the density is Xt- measurable. The equality of the 


[0,t] 


closed walk characteristics implies that for all 0 < r < t there exist a potential 
dr : df —)■ M such that 


log(fc^^(r, Z ^ z')) = log(j(r, Z ^ z')) + 4>r{z') — br(^), Vz —)■ z'. 


(19) 


The proof of this is standard, see Lemma B.2. Because of the regularity of k^'^ 
and j, we can always choose (pr to be continuously differentiable in the time 
variable. Plugging the expression tor k^^ we derived at (19) in (ii) we obtain 
that (pr satisfies the HJB equation (16) on the restricted domain [0,t] x X. But 
then, 

- [\k^^-j){r,Xr-)dr 
Jo 

= / j{r,Xr- ^ z'){l - exp{(j)r{z') - (l)r{X~)))dr 


= / dr(j)r{Xr-)dr. 

Jo 

Using (19) and (20) and Step 1, Girsanov's formula rewrites as 


^^[o,t] 


dR] 


[0,i] 


= exp I / dr(i)r{X^-)dr + (f)r{Xr) — (JriX^-) 

0<r<t,X 


( 20 ) 


Because of the regularity in time of 0, we can apply the Ito formula to conclude 
that 


J%,t] 


= exp (0i(Xt) - (j)o{x)). 


Step 4. In this step we show that the density is Xi-measurable. This is a conse- 

dp^y 

quence of the fact that converges in to Because of Step 3 we have 


[O.t] 


that for any r < 1, if t > r. 


jp^y 


dR\ 


[O.t] 


is a{X[r,i]) measurable, and therefore so is 
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But then it is measurable with respect to nr<iSince 

P^y{Xi = y) = 1, then is exactly The proof is complete. □ 


Proof of Theorem 2.7. • Proof of (a). Because of (28) and P E R-ij), we have: 


P(T( <t = h/2\Xt = z, Xt+h = z', Tl > f + h) 


= R{Tl E t + hi \ Xt = z, Xt^h = z\Tl > t R h). 


( 21 ) 


Therefore it suffices to do the proof with R instead of P. 

Recall that for a Poisson process with intensity X{t) the density of the law of the first 
instant of jump is f hh \{t) exp(— A(s) ds), t > 0. Therefore for all r e [0,1], 

P(T( < f + hr, Xt+h = z', T 2 > t + h j Xt = z) 

j(t + r,z^z') / 

exp I — / j[t + s, z ) ds j dr 


rh 


j{t + r, z) exp ( - / + s, z) ds 

nhr 


= h exp 


'0 


j{t + r,z) 

j(t + s, z) ds^jit + hr, z ^ z') exp (^~ j(t + z') ds^ dr. 


Using the following expansions as h tends to zero: 


exp 

exp 


(*hr 


j{t + s,z)ds] = 1 — j{t, z)hr + o{h), 


' hr 


j{t + s,z')ds\ = 1 — j{t, z'){l — r)h + o{h), 


j{t + hr,z^z') = j{t, z ^ z') + dtj{t, z ^ z')hr + o{h), 


we obtain 


R{Tl Et + hr, Xt+h = z',T 2 > t + h \ Xt = z) 


= hj(t, z^z') il + h 


dtj{t,z^z') - - , ■ 


dr + o{h^ 


= hj{t, z -E z') + h[Xa\j]{t, z -E z')t‘^ /2 - j{t, ^')^}) dr + o{h^). 


In particular, with r = 1 this implies that 

R{Xt+h = z',T 2 > t P h \ Xt = z) 

= hj{t,z -E z'){l + h{Xa[j]{t,z -E z')/2 - j{t,z')}) + o{h‘^). 


When r = 1 /2 we have 

R{Ti P t P h/2, Xt+h — z!, P\ > t P h \ Xt = z) 

= hj(t,z ^ z')(l/2 P h{Xalj](t,z ^ z')/8 - j(t,z')/2}) P o(h^). 
Taking the ratio of these probabilities leads us to 

R(T^ P t P / 1/2 I Xt = z,Xt+h = z', T 2 t P h) 

_l/2 + h{Xa\j]{t,z -E z')/8- j{t,z')/2] P o{h) 

1 + h{Xa\j]{t,z -E z')/2 - j{t,z')] P o{h) 

= 1/2 - hXa\j]{t,z -E- z')/8 P o{h). 


With (21) this gives (11). 
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• Proof of (b). Using again (28) we just need to prove the statement under R rather 
than P. Since R{Xt = Xt+h = z) = R{Xt = 2:)(1 + o(l)) as h ^ 0+, we can write the 
proof with R{- \ Xt = z) instead of R{- \ Xt = Xt+h = z). Therefore, ii c = {z = xq ^ 
xi -)■ a:|c| = z), 


Ri{Xt —)■ Xrpt Xrpt ) — C, T|j,| < t + h < Tjc| + 1 I Xt — 


f 

c 


rU 

/ ] 


exp 

- / j{s,Xi_i)ds 




. Jti-l 


jiti,Xi Xi+i) 
pt^h 


X exp 


j{s,z) ds 


t|c| 




= ^c[j](t,c)(l + o(l)) 




exp 


t r 


Z=1 


j{s,Xi_i)ds 

pt-\-h 


j{s,z)ds dti---dt\c\ 


t|c| 


= X,[j1((.c)A''l/|c|!+o(ftl”l; 


where we used the convention that to '■= t. This completes the proof of the theorem. □ 


4. Examples 

In this series of examples, we illustrate Theorem 2.4 improved by Proposition 2.5. We 
compute the reciprocal characteristic X[j] and sometimes we consider the characteristic 
equation (9). 

Birth and death process. The vertex set is df = U with the usual graph structure 
which turns it into an undirected tree. The reference walk R is governed by the time- 
homogeneous Markov intensity j{z^z + l) = X>0, z>0 and j{z ^ z — 1) = > 0, 

z > 1. Clearly, the set of all edges = generates C and the charac¬ 

teristics of the reference intensity are 

f Xa[j]{z Z + 1) = Xa[j]{z + 1 -i- Z) = 0, Z > 1, 

^ ^a[j](0 —)■ 1) = —Xa(l —)■ 0) = /i, 

[ X.c[j]{z O Z -|- 1 ) = A/i, Z > 0. 

Time-homogeneous Markov walks in Tl[j]. Let us search tor such a random walk P. We 
denote A( 2 ;) the intensity oi {z ^ z + 1) and Jx{z + 1) the intensity {z + 1 z) oi the 
Markov walk P. By Theorem 2.4, P G R[j] if and only it 

( A(^ -L 1) -L fi.{zT 1) - A( 2 ;) - jl{z) = 0, ^ > 1, 

< A(l)-I-/i(l) — A(0) = p, 

[ \{z)jl{z -|-1) = Ap, z > 0. 

The solutions to the the above set of equations can be parametrized by choosing A(0) 
arbitrarily and finding X{z + 1), Jx{z + 1) recursively as follows 

f jl{z -|-1) = X{z)~^Xfi, z > 0, 

( A(z -l-1) = /i -|- A(0) — fi(^z 1), z P 1. 
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With some simple computations one can see that for any large enough A(0), the above 
system admits a unique positive and bounded solution. Hence, the corresponding 
Markov walk has its sample paths in and it is in 

Hypercube. Let X = {0,1}'^ be the d-dimensional hypercube with its usual directed 
graph structure and let be the canonical basis. For x e X, we set x* := x + gi 

and = X + + gk where we consider the addition modulo 2. Let 

5 := {(x —>• X* —>■ x*^ —>• x^ —)■ x), X E X, 1 < i,k < d} 

be the set of all direcfed squares. One can see fhat for any given free T, a T- basis of 
closed walks can be consfrucfed by selecting only closed walks from fhe sef 

SUS. ( 22 ) 

This gives a practical canonical way to check the conditions of Theorem 2.4. 


The bridge of a simple random walk on the discrete hypercube. Lef j be the simple random 
walk on the hypercube. The intensity z —>■ z') of the xy-bridge can be computed 
since the transition density of fhe random walk is known explicitly. We have 


fy{kz^z^) = 


cosh(l — t)/ sinh(l — f), if 7 ^ Vi, 

sinh(l — t)/ cosh(l — f), H Zi = Pi, 


(23) 


where Zi and pi E {0,1} are the i-th coordinates of z and p E X. 

We provide an alfernafe proof based on the characteristic equation (9). First, it is im¬ 
mediate to see that under any bridge, all arcs of the hypercube are active at any time. 
From Xc[j^y] = Xc[j], we deduce that the arc function \og{j/j^y){t, ■) is the gradient of 
some potential ipt, see Lemma B.2. The equality of fhe arc characferisfics implies fhaf 
for all t E (0,1) and z E X 

d d 

dtf{t,z) + '^[exp{ijjt{z") -i/Jt{z)) - 1] = dt'ijj{t,x) ^[exp(?/>t(x*) - ft{x)) - 1]. 

i=\ i=l 

Since ip is defined up the addition of a function of fime, we can assume withouf loss of 
generality that for all 0 < f < 1, dtipt{x) + ~ ft{x)) — 1] = 0. Hence ip 

solves the HJB equation 


dtip{t, z) -h ^[exp('0t(^*) - iptiz)) - 1] = 0, t E [0,l),z E X. 


i=l 


The boundary data for ip are 


\im. Ip t{z) = 


t-5>l 


-cx), iizfp, 
0 , iiz = p. 


One can check with a direct computation that the solution of (24) & (25) is 


fd^z) = ^iog[i + (-i)(^» 


-j/bp2(i- 


9] 


(24) 


(25) 


(26) 


2=1 


where fhe subfracfion is considered modulo fwo. By fhe definition of ip, we have 

fy{t, z^ z^)= jf, z -E z^) exp{iPt{z^) - iPt{z)) = exp{iPt{z^) - iPt{z)) 

and (23) follows with a simple computation. 
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A triangle. We consider the triangle (a, 6, c) with arcs between any pair of vertices. 
We define the reference intensity j to be 1 on every arc. Our aim is to compute the 
intensity of the ah bridge through the characteristic equation. As a tree, we pick 
T = {a ^ b ^ c). The corresponding equations are 

f dt log a —)■ 6) + h) — a) = 0, 

I dt log 6 —>■ c) + c) — b) = 0. 


For the closed walk component, we can choose C = {(a —>■ b —)■ c), (a —)■ b),{b —>■ 
c), (c —a)}. Thus we have 


' a —)■ b —)■ c)j“^(c —)■ a) = 1, 

a —)■ b)j‘^’^{t, 6 —)■ a) = 1, 
b —>■ c —)■ 6) = 1, 

c —>■ a —)■ c) = 1. 


Concerning the boundary conditions, we have: 


lim 


- log(i?“(6)) + 1, it* = 6, 

—oo, otherwise. 


This system of coupled ODEs can be solved explicitly, using the fact that the transi¬ 
tion density can be explicitly computed. One can check directly that if we define the 
functions 


^o(t) := l/3 + 2/(3e^/2)pQg 

^i(t) := l/3 + 2/(3e^/2)sin -7r/6^, 

^2{t) := l/3-2/(3e^/2)sin |^^ + 7r/6^, 

we obtain 

f a ^ b) = c —>■ 6) = (.^0 + '^1 + ^ 2 )/{^ 1^2 + 'Ci'Co + ^ 2 ^o){'t), 

< b ^ a) = b ^ c) = a ^ b), 

[ a —)■ c) = c —)■ a) = 1. 


Complete graph. The directed graph structure of the complete graph on a finite set 
X = IT’D consists of all the couples of distinct vertices, the set of arcs is = 

\{{x,x);x e X} . Pick an arbitrary vertex * e X and consider the set 

A :={(*—)■ 2; —)■ 2;' —>■*); 2 ;, 2;', * distinct} 

of all directed triangles containing *. Then, as indicates Figure 1, it can be shown that 
for any tree T we can construct an associated basis of closed walks by drawing from 
the set A. 
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Figure 1. Decomposition of a simple walk into 2-walks and 3-walks 


Some sampler. Let us analyze in a bit more detail one example of a walk on the complete 
graph. Take m G P(T:’) a positive probability distribution on the finite set X. The 
detailed balance conditions: m{z)j{z —)■ z') = m{z')j{z' —>■ z),'iz,z', tell us that the 
intensity 


j{z z') 



z.,z! ^ X 


admits m as its reversing measure. The characteristics associated with j are 


Xa[j]{t, {z ^ z)) = (m{z') - m{z) 


xex 


Xc[j]{t,c) = 1 


for any 0 < f < 1, any arc {z —)■ z') and any closed walk c. 


Cayley graphs. Let {X, *) be a group and Q = {gi, i G /} be a finite subset of gener¬ 
ators. The directed graph structure associated with Q is defined for any z,z' e X by 
z z' ii z' = zg for some g G G- We introduce the time independent reference intensity 
j given by 

j{z -)■ zgi) := ji, \/z e X,gie G, 

where ji > 0 only depends of the direction gi. The dynamics of the random walk R is 
Markov and both time-homogeneous and invariant with respect to the left translations, 
i.e. for all Zo, z, z' G df, 3 {zoZ —>■ Zoz') = j{z ^ R). For all arc {z —)■ z'), we have 

Xa{z z) = 0 

and the closed walk characteristic Xc is translation invariant. 


Proposition 4.1. Let j and k be two positive Markov intensities on this Cayley graph which 
are time-homogeneous and invariant with respect to the left translations. Then, they share the 
same bridges if and only if for any n > 1 and (L,..., G with gi.^ - ■ ■ = e, we have 

jil ■ ■ ■ jin ■ ■ ■ ^in- 

As usual, we have denoted e the neutral element. 

Proof. We have already seen that Xa[j] = Xa[k] = 0. On the other hand, the relation 
9ii---9in = e means that c := (e -)■ gi^ gi^gi^ g^gi^ ■ ■ ■ gtn-i -t e) is 

a closed walk and the identity means that ^cb1(c) = xfkfc). 

We conclude with Theorem 2.4, Proposition 2.5 and the invariance with respect to left 
translations. □ 


Remark 4.2. If the group X is Abelian, Proposition 2.6 can be further sharpened by 
considering only finitely many sequences (A, •••, in)- This is done in [CR, Cor. 16]. The 
equation (17) in [CR] corresponds to the equality of the closed walk characteristics. No 
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mention of the arc characteristic is done, since in the case when the jump intensities are 
translation invariant, they are always zero. 

Triangular lattice. The triangular lattice is the Cayley graph generated by gi = (cos(^(z— 
1), sin(^(z — 1)), i = 1, 2, 3, and we consider a time-homogeneous and translation in¬ 
variant Markov intensity j. 



Figure 2. Two different space-time homogeneous random walks on the 
triangular lattice which belong to the same reciprocal class 




Figure 3. The closed walk characteristics coincide 
For any closed walk {z z + gi) associated with an edge, we have 

Xc[j]{t, Z ^ z + gi) = Jij-i. 

If we take any counterclockwise oriented face, i.e. a closed walk of the form /S.z '■= {z ^ 
z + gi ^ z + gi + g 2 ^ z) for z e X we have 

Xc[j]{t,Az) = jlj2h. 

We address the question of finding another space-time homogeneous assignment {fc±i}i<j <3 
such that the corresponding walk belongs to Tl{j). Applying Theorem 2.4 or invoking 
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Proposition 2.6, we can parametrize the solutions k as follows 


ki = aji, k_i = 

k2 = 13 j2, k_2 = l3~^j-2 

ka = {af3)-^j3, fc_3 = ajSjs 


k-2 

k-3 


-1 


where a, (3 > 0. Corollary 2.10 gives some details about the dynamics of the bridge 
as the unique Markov walk (modulo technical conditions) that starts in x, ends in y 
and such that, if > 0 is a very small duration: 

(1) At any time t and independently from the current state, it goes back and forth 
along the direction i during [f, t + h] with probability jij_ih'^/2 + o(/i^). 

(2) At any time t and independently from the current state, it goes around the 
perimeter of a triangular cell of the lattice in the counterclockwise sense dur¬ 
ing [f, t + h] with probability jij 2 j'ih^/6 -|- o{h^). 

(3) If exactly one jump occurs during [f, t+h], then the density of the instant of jump 
is constant up to a correction factor of order o{h). This follows from Xa[j]{t, z —)■ 
z') = 0 for all t and {z R). 

The lattice T/. The usual directed graph structure on the vertex set A = is the Cay¬ 
ley graph structure generated by ^ = {gi, g_i] 1 <i <d} with gi = (0,..., 0,1, 0,..., 0) 
where 1 is the i-th entry and we denote g_i = —g^. As another consequence of Proposi¬ 
tion 2.6 we obtain the following 

Corollary 4.3. Two time-homogeneous and translation invariant positive Markov intensities 
j and k on 1/ generate the same bridges if only if for all 1 < i < d, they satisfy 

jij_i = kik_i, <i <d 

where j_i and k_i are the intensities of jump in the direction g_i = —gi- 

Proof This sef of equalities corresponds to the identification of the closed walk charac¬ 
teristic along the edges. But, because the group is Abelian, it also implies the identifi¬ 
cation along the squares, which is enough to conclude with (22). □ 

Hypercube, again. Let us visit once more the hypercube A = (Z/2Z)‘^ which is seen 
now as the Cayley graph generated by the canonical basis gi = (0,..., 0,1,0,..., 0), 
I < i < d, where 1 is the i-th entry. As another consequence of Proposition 2.6 we 
obtain the following 

Corollary 4.4. Two time-homogeneous and translation invariant positive Markov intensities 
on the hypercube generate the same bridges if only if they coincide. 

Proof. The proof is the same as Corollary 4.3's one. But this time g-i = gi, so that 

jij-i = kik-i is equivalent to jf = kf □ 


Appendix A. Shared bridges 
Recall that the reciprocal class is given by 



Clearly, if P G P(j) shares ifs bridges with R. Next proposition gives assertions which 
are equivalent to this property. It is crucial for the proof of Theorem 2.4. 
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Proposition A.l. For any random walks P,Re P(f2) such that suppPoi C suppPoi, the 
following assertions are equivalent. 

(a) P = nij). 

(b) P^y = for all {x,y) e suppPoi- 

(c) There exists a measurable function k \ ^ [0, cx)) such that f^^ k dRm = 1 and 


P = k{Xo,XfR. 


(d) There exists a measurable function h ■. ^ [0, cxd) such that for all x e supp Pq, 

P^ = h{x,Xi)RT 


(e) For all x G supp Pq, P^ G P(j). 

Moreover, the function h at (d) is given by h{x, y) 


dPf 

dRf 


(y)- 


Proof [(a) (6)] ; Take tt = Pqi. 

[(6) ^ (c)] : Take k = dP^i/dR^i. 

[(c) ^ {d)] -.Take h{x,y) = k{x,y)/ER.k{x,Xi). 

[((i) ^ (6)] : As suppPoi C suppPoi, we have P*^ = R^^ = P*^ for all 


{x,y) G suppPoi. 

[{d) ^ (e)] : If {d) holds, then P® = Yhxy&x"^ ^Rolx) ^x=xR^’^■ This decomposition shows 
that P^ G P(j)- 

[{d) (e)] : Fix x supp Po. If P^ G P[j] then there exist some vr such that P writes as in 

27. We can w.l.o.g. assume that 7r{x, y) = 0 whenever x f x. But then 


px 


y&X 


T^{.x,y) 
^ Pf(i/) 

y&X 


R^ 


which shows (d), with h{x, y) = □ 

The identity in (d) expresses that P^ is an /i-transform of R^ in the sense of Doob 
[Doo57]. 

The proofs of Theorem 2.7 and Corollary 2.10 rely on a classical result in the theory 
of reciprocal processes which we recall below at Proposition A.2. It is a consequence of 
the reciprocal property, see Definition 0.1. 

Proposition A.2. For any random walk P G P(H), the following statements are equivalent. 

(a) P G P(j). 

(b) For all 0 < s < t < 1, we have 


P{Xis,t] e ■ I Xt) = P(X[,, 1 ] G ■ I X,,Xt), P-a.s. (28) 

Proof. Statement (b) with s = 0 and t = 1 is nothing but the statement (b) of Proposition 
A.l. Therefore, (b) ^ (a). 

Let us prove the converse statement: (a) ^ (b). Let u be any bounded function on X'^ 
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and B be any -measurable event. We have 


Ep[PiB\Xs,Xt)u{X„Xt)] 


Ep[lBu{X„Xt)] 

'7i{x,y)ER.y[lBu{Xs, Xt)] 

x,y£X 


= Ax,y)ER.y[R^y{B I Xs,Xt)u{Xs,Xt)] 


= <x,y)ER.y[R{B I X„Xt)M(X„X,)] 

x,y£X 

= Ep[R{B\X,,XMXs,Xt)] 


which implies the aimounced result. We have used the reciprocal property of R at the 
last but one equality. □ 


Remarks A.3. 

(a) Any Markov walk is reciprocal, but the converse fails. 

(b) Any bridge of a reciprocal walk is Markov. 

(c) For any reciprocal walk R and any vr G R{X'^) such thaf suppvr C suppi?oi, the 
mixture of bridges (27) is also a reciprocal walk. 

(d) In particular, the reciprocal class of a Markov measure (for insfance 7^(j)) consisfs 
of reciprocal measures. 

For detail about reciprocal path measures, see [LRZ14] and the references therein. 


Appendix B. Closed walks 

Closed walks are necessary to define the closed walk component Xc of the reciprocal 

characteristic, see Definition 2.3-b. 

Definitions B.l (Walk, closed walk, simple closed walk and gradient), ket A (Z 

specify a directed graph (A, —)■) on A satisfying Assumption 1.1. 

(a) For any n > 1 and xq, ... ,Xn G A such that xq —?• xi, a:i —)• X 2 , • • • , Xn-i Xn, the 
ordered sequence (a:o, xi,..., Xn) is called a walk. We adopt the more appealing notation 
w = (xo —>■ Xn). The length n ofw is denoted by |w|. 

(W ff te = (xo —>■ xi Xn) is a walk, then w* is the walk obtained by reverting the 

orientation of all arcs: 

(Xn —)■ Xn-1 To). (29) 

(c) When Xn = xq, the walk c = (tq —t xi —)■■■■—)■ = tq) is said to be closed. 

(d) A closed walk c = (tq —)• xi = xo) is said to be simple if the cardinal of the 

visited vertices {xq, xi,..., Xn-i} is equal to the length n of the walk. This means that a 
simple closed walk cannot be decomposed into several closed walks. 

(e) An arc function £ : A —?• M zs the gradient of the vertex function : A —)■ M z/ 

i{z —>■ z') = "f^z') — fiz), y{z —>• z') G A. (30) 

For any arc function i, we denote £{w) := £{xq —)■ xi) -f • • • -P £{xn-i —t x„). 

Lemma B.2. Let (A, —)■) satisfy Assumption 1.1 and let T be a tree and C be a T-basis of 

closed walks as in Definition 1.2. The following assertions are equivalent. 

(a) The arc function i : A^Ris a gradient in the sense of (30). 

(b) For any closed walk c, i{c) = 0. 

(c) For all closed walks in C, i{c) = 0. 
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Proof, (a) (6). This is standard. If i is the gradient of then f'(w) = '0(x„) — 

which vanishes when w = (xq —>■•••—)■ a;„) is a closed walk. 

(b) (a). Let i be such that ^(c) = 0 for all closed walks c. As (z —)■ z' —>■ z) is a closed 

walk, we have 

i{z —)■ z') + i{z' —)■ z) = 0, Vz O z' e X. (31) 

Choose a tagged vertex * e A, set ^(*) = 0 and for any x f define 

f{x) := ^(w), for any w G {(* —)■ = a:), for some n > 1} . 

To see that this is a meaningful definition, take two paths w = (*—)■ xi ■■■ —)■ Xn) and 

w' = (*-)■ yi ■■■-)■ I/m) such that Xn = Vm = X. As ^ Xi ■ ■ ■ ^ Xn = X = Vm ^ 

Vm-i —>■■■■—)■*) is a closed walk, we have 0 = £(*—)■ xi ■■■—>• x) + i{x —)■ i/m-i —t 
•••—)■*)= ^(w) — f'(w'), where the last equality is obtained with (31). Therefore, f is 
well defined. Finally, it follows immediately from our definition of f that i{z —)■ z') = 

f{z') — f{z), for all (z —)■ z'). 

(b) (c). Consider an arbitrary closed walk (xq —)■ xi —)■ .. —)■ x„_i Xn = aio). The 

proof is by induction on the number of arcs which are nof in T. We can w.l.o.g. assume 
that Xn-i —>■ Xn is one of such arcs. Because of the fact that T is a spaiming tree, there 
exist a directed walk w from Xn-i to xq which uses only arcs in T. Then the closed 
walk f obtained by concatenating xq —)• .. —>■ Xn-i and w s a closed walk which uses 
strictly less arcs not in T than c. Moreover, the walk obtained concatenating x„_i —)■ xq 
with w* belongs to C, by definition of C. Indeed, such a walk is precisely see 

Definition 1.2. By definition of C we have thaf either G C or fxo^xn-i ^ ^ • 

W.l.o.g. we can assume that the first holds (the other case can be analyzed similarly by 
using the fact that S <^C). But then, 

i{c) = -£(w) +l{Xn-l -t Xn) = ^(f) + ^(w*) + l{Xn-l Xn) 

=£(w*) 

= ^ + <(C„_.^.„) = 0 

=0 by induction 

where to conclude that i{w*) = —i{w) we used the fact that £ C C. The proof is now 
complete. 

(c) (a) is obvious. □ 
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